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ABSTRACT 

A study examined the educational process to identify 
teacher role in education and school efficiency in hiring teachers. 
J-he implicit educational model used by administrators is knowni that 
a teaciier*s productivity is a function of experience and educational 
xevel. A conceptual model of the educational process was developed 
which states that education output, itself a multi-dimensional 
factor, is a function of the cumulative background influences of the 
individual's family, the cumulative background influences of his 
peers, nis innate abilities, and the cumulative school inputs. Two 
separate analyses of elementary school processes, based on the model, 
were undertaken, one relying on data from the Northeast and Great 
Lakes of the "Equality of Educational Opportunity" survey (713 
schools) and one using a sample drawn from a California school 
district in 1969 (2445) students). Educational output was measured 
only by achievement tests. Black, white, and Mexican- American 
students were considered separately for part of the study. Major 
conclusions were that (1) teachers do generally count in education; 

(2) schools operate quite inefficiently by hiring teacher attributes 
which lead to little or no achievement gains; and (3) there appears 
to be considerable latitude for public policy to improve our 
educational system. Teacher verbal ability, recentness of education, 
and specific socioeconomic class experience are the best measures of 
teacher quality contained in the data. (JS) 
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It is currently in vogue to clsiiin that the public educa* 

^ ft S tion system is failing us. This is supported by a variety of 
®vidence on incomes, racial disparities in achievement, and so 
^®^th. However, such statements by themselves are not very useful 
since, even if true, they provide the educational decisionmaker 
with no information from which to do his job better. It is singly 
easier to provide a balance sheet of the outputs of education than 
it is to provide prescriptions for action, and this fact accounts 
for why there has been more analysis of the results of education 
than of methods of improving education. 

Hopes -for improving public education in the u.o. depend 




upon our learning from past experiences, yie must be able to 
assimilate the results of past educational programs and past 
instruction, however, the complexities of education make this 
assimilation very difficult, bchool administrators are often 
good at making judgments about very specific aspects of education. 
Jt'or example, a principal often can make a good Judgment about 
which teachers are getting results and which are not. Yet, at 

the same time he has difficulty in pinpointing the characteristics 
I am indebted to John Jackson for many helpful suggestions. 
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which lead to "getting results." ne will often conclude that 
it*s all in the individual, dut, if this is truly the case, we 
have little hope for improving public education. In order to 
improve our educational system we must be able to make some 
generalizations about characteristics of teachers which are more 
or less favorable to education. 

fhis paper looks at the educational process with the aim 
the role of teachers in education, raoreover, since 
the implicit model of education used by administrators is known — . 
namely that a teacher's productivity is a function of experience 
and educational level, it is possible to make some statements 
about the efficiency of schools in their hiring of teachers. After 
sketching a general model of the production of education, the 
paper presents two separate attenpts at estimating models of 
education. The first relies upon the data from iiflualitv of 
aducational Opportunity the second uses a new sample 

collected from a California school system during the summer of 
1969. From these analyses it is concluded that: 1) teachers do 

generally count in education; 2} schools now operate quite 
inefficiently; and 3) there appears to be considerable latitude 
for public policy to improve our educational system. 

♦J^es S. Coleman, et al . Bquali ty of iducational 
Opportunity (Washington, D.C.: Government Printing Office, I966), 

commonly known as the* Coleman Report. 



II. Conceptual i»iOdel 



It is not possible to look at the role of teachers in 
educa*-.ion in isolation. Instead, one must consider all of the 
factors that enter into educational process and how they interact 
with one another. Thus this study of the effects of teachers on . 
the education of children rightfully starts with a discussion of 
a larger model of the educational process and the various factors 
that enter into it. Af'ter presenting an abstract model of the 
educational process, this section considers specific measurement 
of the various inputs to the educational process and the outputs 
of the educational process. If one can identify and measure the 
effects of schools and teachers on education of individual children, 
then one can make some statements on how best to organize the 
school to provide the most educational output. 

Hie basic model of the educational process can be depicted 
by an equation such as idquation 1. 



( 1 ) 4 ^ = 



k.> 






where 



-it = vector of educational outputs of the i^^ student 
at time t 

vector of family inputs to education of i^^ 

, student at cumulative time t 

vector of peer influences of i^^ student 
cumulative to time t 

I3 = vector of innate endowments of i^^ student 

” vector of school inputs to i^^ student cumula* 
tive to time t 



- 4 . 



This model sii? 5 )ly states that educational output itself 

a multi-dimensional factor, is a function of the cumulative 

background influences of the individual's family of the 

* - « 

cumulative influences of his peers of his innate 

abilities (I^) and of the cumulative school inputs 
while this abstract model is not very operational, it does provide 
a framework for discussion of models of the educational process 
which can be tested eaipirically. 

specific measures oi each of the inputs listed in 
iiquation 1 are derived from a combination of past work in the 
f^l®ld, theoretical considerations, and sheer data availability* 

For instance, one can think of many measures of the output of* the 
educational process. It would be possible to use standardized 
test scores, juvenile delinquincy rates, future income streams, 
or level of education cony^leted. However, for any given sample 
of data one is usually hard pressed to find more than one of these 
specific measures. While theoretically one thinks of schools 
producing several different outputs, usually lumped under the major 
categories of cognitive development and socialization, the 
availability of data has restricted most past studies to examining 
a single output. Indeed, this will be the situation in the analysis 
that is presented in this paper. This paper concentrates entirely 
on an analysis of cognitive development as reflected in scores on 
standardized ability and achievement test scores.* It is 




* Two dif 1 erent tes ts are us ed in the cour s e of the 



-3- 



believed that these scores represent differences which are valued 
by society.* 

The inputs are also subject to many of the same considera- 
tions as the measure of output. 'There is no firm theoretical 
basis for choosing inputs. jLikewisef there is often a lack of 
desired data. Each input vector will be discussed in turn. 

Families contribute to the education of children in many 
different ways. They provide basic shelter and food for the indi- 
vidual child. But more than that, they provide models of verbal 
structure, examples of problem solving, and a basic set of attitudes 
to the individual child. To meastore each of these concepts 
explicitly would be a very difficult task, but for our purposes 
this is not really necessary. It is widely accepted that the 
relevant educational inputs are highly correlated with the socio- 
economic status of the family. Thus one can indirectly include 
the effects of each of these individual family inputs in the 



analysis: 1) Educational Testing Service* s School and College 

Ability Test (SCAT) for verbal ability in grade 6, and 2) Stanford 
Achievement Test for reading in grade 3» 

♦There is scattered evidence on this in w. Lee Hansen, 
Burton A. Weisbrod and William J. Scanlon, "Determinants of 
Earnings of low Achievers: Does Schooling Really Count, Even 

for Them?", mimeo. Institute for Research on Poverty, University 
of Wisconsin, February 1969; ourton A. Weisbrod and Peter 
Aarpoff, "i'ionetary Returns to College Education, Student Ability 
and College Quality,*' The Review of Economics and statistics, 
JMoveraber I968; and Randall D. weiss, "The Effects of Education 
on the Earnings of Blacks and whites, "Discussion raper ho. 44, 
Program on Regional and urban Economics, narvard University, 

April 1969. 
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educational process by including a set of measures of socio- 
economic status. Ihese measures include parents* educations, 
goods in the home, family size and father’s occupation. 

groups provide many of the same inputs that the 
families provide. The individual child’s peer groups would 
include his friends both inside and outside of school. To be 
precise, one would want to know exactly which individuals were 
friends or tended to interact with each other, but collecting 
this kind of information on a very large scale would be prohibi- 
tively expensive. In this case, it seems acceptable to aggregate 
all classmates of the individual in the classroom or school and 
taxe that as the peer groups. In measuring the interactions' of 
individual children one can use the same proxies for peers that 
are used in the case of the individual’s family, that is, use 
socio-economic status as a proxy for the types of interaction 
which exist araong friends. Ihus for peer groups we would want to 
take aggregates of the individual family background measures. 

Inna^ abilities is probably the most difficult concept to 
measure in the whole model. In fact, it is not well understood 
how innate abilities enter into the educational process, and there 
exists considerable controversy over the role of innate ability in 
education. The only consensus which appears to exist in the area 
is that comraon iQ scores do not do an adequate job of measuring 
innate abilities. All is not lost, however, when innate abilities 
cannot be measured directly. In particular, under a set of 
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plausible assun5)tions ^which will be detailed in the empirical 
section) it is possible to circumvent the most serious problems. 

bchool influences are the focus of this study and will be 
discussed in more detail than the other inputs. Ihe hypotheses 
to be analyzed actually are quite simple and straightforward. It 
is surprising how little is actually known about the ways in 
which schools and teachers affect education. This largely 
results from a fixation on inputs to education rather than outputs. 
However, one can iu5)ute a set of hypotheses about teacher effects 
from the behavior of schools. In particular, schools base pay 
schedules on teaching experience and educational levels. Thus, 
they must believe that increased experience and further schooling 
have a positive relationship to educational output. These provide 
two central hypotheses in the study of the educational process. 

Other hypotheses can also be found in the actions of 
school administrators. A frequent compensatory education plan is 
the reduction of class size. Since this is a very expensive under- 
taking, the presumed benefits (increased outputs) must be great. 

Also there are a large number of people who argue that some forms 
of student distributions in the schools and classrooms (e.g., 
ability tracking or racial and social integration) have a beneficial 
effect on education.* All of these are testable hypotheses about 
the relationship between school inputs and achievement. 



*Cf. U.S. Commission on Civil Rights, Racial Isolation in 
the Public Schools (tf/ashington, D.C.: Government Printing Office, 
1967). Chapter III. 




Iftirther, in recent literature (particularly Equali.ty of 
jjducational Opportunity J_E!£Oj there is a suggestion that one 
can measure other dimensions of teacher and school quality# 

These include attitudes of teachers and administrators, verbal 
facility (and perhaps general ability) of teachers, quality of 
physical plant, quality of teacher education, background of 
teachers, and more. 

Together the above forms the rudiments for a testable 
model of the educational process, 'while some modifications are 
required because of data limitations, this basic structure will 
hold in the empirical section. 

iiX. Mnpirical Analysis 

Two separate analyses of the educational process in ^ 
elementary schools area have been undertaken in this paper. The 
first relies upon the data for the Northeast and Great Lakes of 
^'quality of Educational Opportunity . The second uses a san^le 
drawn from a California school district dialing 1969* Each of 
these analyses will be described separately, and then they will 
be compared for consistency and conclusions. 

multisystem School Analysis * 

The well knpwn report Equality of Educational Opportunity 
assembled the best data bank on public education to date. This 



*This section relies heavily on analysis presented in more 
detail in Eric Hanushek, •’The Education of Negroes and Whites*' 
(unpublished Phu dissertation, Massachusetts Institute of Techno- 
logy, 1968). 
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1965 siarvey collected a wealth of data pertaining to students, 
schools and the outcomes of education. A reanalysis of these 
data comprise the first section of applications of the basic 
educational model.* 

fhe survey collected data on some 570# 000 students and 
67 f 000 teachers across the country. It was a purely cross 
sectional survey of students in grades 1, 3# 6, y# ^.nd 12. 
1‘iinorities were intentionally overrepresented in the sai»5)le. 

'ihe student information included a set of standardized 
test scores (verbal ability, nonverbal ability, reading achieve- 
ment, and mathematics achievements) and questionnaire responses 
to both objective questions about the students* background and 
subjective questions about the students* attitudes toward school 
and society and the parents* attitudes about similar issues. 

The teachers in the sampled schools completed a question- 
naire concerning objective background characteristics (education, 
family background, experience, etc.; and subjective characteristics 
(attitudes toward students, minorities, compensatory education, 
etc.), ‘ihey a3.so completed a simple verbal facility test. 

Finally, principals and school superintendents supplied 
information on general school characteristics, curricula, and 

*The shortcomings of the analysis in iiquality of x*kiuca- 
tional Opportunity which suggest a reanalysis would be valuable 
are discussed elsewhere. Cf. Eric hanushek and John Kain, '’On 
the Value of Equality of Educational Opportunity as a Guide to 
Public Policy,*' Discussion paper No. 36, Program on Regional and 
brban Economics, Karyard University, I968. 
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their personal backgrounds and attitudes. 

In using these data to test the laodel of the educational 
process, two factors are immediately evident. The data do not 
relate school and teacher inputs to individual students. In no 
place is there any information on specific inputs received or 
available to an individual student. One only knows what school 
averages look like. Therefore, there would be considerable error 
in the school input variables if one attempted to estimate a model 
for individuals liKe Equation 1. Secondly, there is no measure 
of innate abilities in the model. 

The first problem, the inability to estimate models for 
individual students, is overcome by looking at total school models. 
Instead of using the achievement of individual students as the 
output of the educational process, students are aggregated across 
schools so that average scores for a given grade represent the 
output. At the sarae time, inputs are aggregated across the school 
so that average background characteristics and average school 
characteristics form the inputs. This tends to minimize the data 
problems introduced by incompatibility of student and school data. 

One obvious loss from this aggregation is the influence 
of peers on students. It is no longer possible to differentiate 
between family backgrounds (in aggregated form) and peer influences. 
(One crude peer effect can be analyzed. This is the effects of 
one racial group on others. Hov/ever, this becomes tricky to 
interpret because of the inter'^wined and competing hypotheses 
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involvGd in the racial influence variables.) 

Innate abilities are not handled as neatly. There is no 
direct measure. However, at least for whites, it is reasonable 
to assume that this factor is fairly well captured in the family 
background variables. This is the case if innate abilities tend 
to be hereditary and if social mobility is highly correlated with 
ability.* For blacks, where the parent to son correlations of 
SjiS are not nearly as pronounced, this logic is more strained.** 
The principal problem arising from lack of measure of initial 
endowments is biased statistical results, aut bias only arises 
when the excluded variable (innate aoilities) is not independent 
from the included inputs. Thus, even in the black case, severe 
problems at least at the school level do not arise unless there 
is a mechanism which leads to the correlation of innate abilities 
and specific school resources. For the purposes of analyzing 
school and teacher influences this omission, then, does not seem 
too damaging. Note, however, that this factor further complicates 
the family background factors. Those who would attenqjt to derive 
policy inrolications from the background portions of the model are 
warned again of the extremely complicated nature of that set of 
inputs . 

The specific school analysis undertaken involved estimating 

*Feter i-u hlau and utis li. Duncan, The itmerican Occupa- 
tional btructure (ivew York: John Wiley and Sons, 1^67). 

♦See The American Occupational Structure . 






t 

I 

I 

- 12 - 

separate black and white models. Separate models were estimated 
for two reasons. First, since many of the inputs — particularly 
the background lactors are measured by social class proxies, 
there is no reason to assume that these nominal measures imply the 
same behavioral content. Secondly, there is no reason to assume 
that the educational process is the same across racial lines. In 
fact many people maintain strongly that differences do exist. 

Bie analysis is concentrated upon the sixth grade students 
in the oample. This choice was the result of two factors. The 
inability to include historical information due to the cross 
sectional survey with little data on the past indicated that data 
from earlier schooling with less chance of moves, changes in 
status, etc. introducing error would be superior, however, there 
was a trade-off here because the students supplied all of the 
information on their background (no consultation with parents); 
going back to the first and third grades would introduce a 
different type of data error. The desirability of using, elementary 
schools for the analysis is immediately obvious. The generally 
simpler school organization, the more standardized curricula, and 
the more homogeneous size make elementary schools much more 
attractive for modelling than intermediate or high schools. 

The samples used for the analysis included all urban 
elementary schools from the Northeast and Great Lakes regions 
of the Equality of Educational Opportunity survey that had 
at least five white or black sixth graders. This yielded 
471 schools with five or more white students and ZkZ 
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schools with five or raore blacks. In both sajnples the racial nix 
contains observations across the whole spectrxim from less than 
5 percent of the opposite race to over 95 percent, although both 
samples are heavily represented by highly segregated schools. 

Results — multisystem , school analysis 

Models of education for whites and blacks were estimated 
using regression techniques.* In both cases a multiplicative 
(log-log) functional forra proved superior to a linear form. Thus, 
the estimated coefficients can be interpreted as elasticities.** 
Three separate measures of teacher quality proved significant in 
the models: teacher experience, teacher verbal facility test 

scores and the percent of students with a nonwhite teacher during 
the previous year. The effects of teachers on the production of 
verbal achievement is presented in Table 1 along with the means and 
standard deviations. The complete models are found in Appendix A. 
Since the focus of our attention is on the effects of teachers, 
only teacher effects are shown in Table 1 even though the estimates 
were derived from a larger model. Suffice it to say here that the 
background variables appear to do a good job of measuring home and 
peer influences on education. Further, the estimated effects of 

*Because of the heteroscedastic errors introduced by using 
school observations, weighted regression techniques were used to 
improve the efficiency of the estimators. See ’’The ijkiucation of 
ivegroes and Whites,” Appendix A. 

**An elasticity presents the percentage change in verbal 
achievement that will result from a one percent change in the given 
input, hathematically, 

elasticity = *• 

lo change in input value. 
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TAisLij; 1 



rfiACKER £t'FiiCIS OH ViKiiAL ACHliiVii-iciir, liKAito AND 
:>TANDAiiD Dfii/lATIOfiSi 




Variable 



elasticity i-*ean Stnd. Dev. 



WHITE i^DEL 



Teacher Experience (years) 


.020 


11.9 


4.6 


Teacher Test bcore 


.11? 


24.6 


1.4 


p Students with Nonwhite 
Teacher last fear 


o 

1 


13.4 


16.0 


nLkCK fiODrl. 








Teacher experience (years) 


.0^4-5 


11.3 


4.0 


Teacher Test Score 


.178 


24.0 


1.8 


;6 Students with iwnwhite 
Teacher Last fear 


-.026 


44.? 


19.4 



Complete model; Verbal = f(goods in home, father*s education, 

family size, attitudes, central city, 
racial composition, and teachers) 



teacher inputs seem to be invariant to the precise formulation 
of background factors and to the inclusion or exclusion of the 
attitudinal variables. 

bince the school influences in the two models appear quite 
similar , it is possiole to discuss both models at the same time. 

^ One of the more interesting features of the models is that only 
one factor which is explicitly purchased by schools affects achieve- 
■ ment; this is teacher experience, further, the small coefficients 
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indlcate that e^erience does not have an overvheliiiing effect on 
achievement* 'Ihe existence of "seniority rights” in school 
selection sviggests an upward bias as school achievement could well 
influence selection by teachers. However, indirect evidence of the 
insignificance of direct attitude variables about school selection 
by the teachers indicates that this variable is chiefly a "pure” 
experience measure. It is somewhat surprising that the elasticity 
is constant across the whole .vange of experience, although tests 
for differences in different ranges proved insignificant. 

The teacher verbal test score represents the best measure 
of teacher quality contained in the data. This provides a method 
of making standardized comparisons across teachers but is a still 
crude measure of teacher quality. It gives some measure of the 
technical competence of the teaching staff in one particular 
dimension ~ verbal ability, and it probably acts as a partial 
proxy for general intelligence. Nevertheless, there are many 
other dimensions of teaching, e.g., rapport with the class, empathy, 
warmth, knowledge of subject matter, whicn are valuable in 
teaching but not included in this measure.* Given these short- 
comings, the magnitude of the effect is significant. The elas- 
ticity of .12 (.18) for such a poorly measured indicator of 
teacher quality provides considerable encouragement in the ability 

♦The narrowness of this quality measure is further 
attested to by similar analysis of the production of mathematics 
achievement test scores. In those models the elasticity drops 
to .09 and the t— ratio goes to 1.3* This indicates a more narrow 
technical competence interpretation. 
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of schools to affect children. Table 2 indicates the snail 
variation in this neasure; the standard deviation for whites 
equals only 1.4 with a mean of 24.8 and a maximum score of ^0 
with a black saiiiple mean approxiioately one point less. Neverthe- 
less, there are wide fluctuations of scores even within cities. 
Within one sampled city, there were differences of 40 percent 
between the best and worst schools.* Switching the teacher staffs 
would result in a five to seven percent increase in average 
achievement. 

The final teacher quality measure is the percentage of 
sixth graders who had a nonwhite teacher during the last year. 

This is interpreted as a measure of part of the teacher quality 
•distribution, i.e., the lower end of the distribution. This 
interpretation arises from our knowledge of the education provided 
to blacks, iiany studies, including a survey of colleges presented 
in Equality of Educationa l Opportunity , show the general quality 
gap between Negroes and whites who go into teaching.** This is 
not particularly surprising giyen that blacks are giyen inferior 
elementary and secondary school education and then proceed to 
segregated colleges which tend to widen the educational gap (by 
race).*** 

*The other teacher variables in these schools vrere roughly 

equal. 

** EEQ . Chapter IV and James A. Davis, Undergraduate Career 
Decisions (Chicago: Aldine Publishing Co., 1965). 




***EEU, Table 3.121.1 
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before discussing the larger implications of these results, 

it is useful to digress for a moment and discuss some of the school 

factors which proved insignificant in modelling the educational 

process. Ihese include teacher degree level, sex, age, teaching 

certificates, attitudes toward teaching and the students, measures 

of teacher background, and class size. Certainly, there are 

considerable measurement errors in each and these errors will 

( 

affect the significance of the various factors. However, none 
seems to exert a strong influence on achievement. 

A few general conclusions arise from this analysis. First, 
the general low effect of purchased aspects of teachers (advanced 
education and experience) indicates that schools are acting 
inefficiently, bince school systems pay handsome bonuses for 
these attributes, it is only economical to have people with 
advanced degrees if they contribute a proportionately higher 
amount to achievement. This does not appear to be the case. 

However, these models do not support the contention that 
schools do not count. To the contrary, they imply that higher 
quality teachers do produce higher levels of achievement. Further, 
given the general problem of measurement errors in the data and 
the crudeness of the variables, the coefficients tend to be under- 
estimated or biased downward.* Looking at Table 1 , there is also 
the distinct impression that teacher quality impacts more on 



♦See J. Johnston, jjconometric Methods (i\iew York: HcGraw- 

Hill Book Co., 1963), pp. I48-I5O. 
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blacks than on iriiites. V<h.lle differences in the coefficients are 
small, they are consistent. If in fact this is the case, it 
indicates that schools can increase educational achievement for 
whites and blacks by allowing for these differences in the educa- 
tional process. For example, it would be able to increase black 
achievement without changing white achievement by shuffling 
teachers with more experience into predominantly black classrooms 
(and possibly compensating predominantly white classrooms with 
more verbal teachers). 

It is unreasonable to push these models too hard. Biey 
make two essential points. First, teachers do appear to matter. 
Setter teachers (better here in a very limited way) achieve better 
results. Second, schools appear to be inefficient. They appear 
to be hiring the wrong things.* 

Single System . Individual Student Analysis* * 

A similar type of analysis was carried out v/ith a different 
set of data which allowed a more accurate measure of the teacher 
inputs received by each child. In particular, individual students 
were matched with individual teachers. This allowed for an 

*This should be qualified somewhat. isVen with* fixed 
salary schedules , Henry Levin in Recruiting Teache rs for Large 
pity Schools (forthcoming) shows that it is possible to estimate 
supply functions for ’other characteristics ~ particularly things 
like teacher verbal test scores. 

**The analysis presented in this section is part of an 
ongoing study of education sponsored by The RAIvD Corporation. 

However, this should not be taken to represent the official views 
of The RAHD Corp. 
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historical element to be introduced by matching with past teachers 
and alleviated the need to estimate school production functions* 
Thus, the data came much closer to the conceptual model of 
Equation 1* 

The basic sample of data was drawn from a large school 
system in California during the summer of 1969 , All children in 
the third grade during the school year 1968-1969 were initially 
included in the sample* For these 2445 students, information on 
family background, scores on the Stanford Achievement Tests, and 
names of teachers vjas abstracted from cumulative records* At the 
same time, all kindergarten through third grade teachers currently 
in the system were surveyed for information fairly similar to that 
contained in ^quality of Educational Opportunity * Information was 
collected on teacher backgrounds, attitudes and specific aspects 
of schooling* An attempt was mde to ascertain their use of 
time, i*e*, the division in the classroom between instructional 
efforts, disciplinary efforts and administration* Also, a verbal 
facility test was given each teacher** The sample used for this 
analysis was developed bjr applying two criteria to this group of 
all third graders* First, individuals vjere eliminated from the 
sample if data were not available on both their second and third 
grade teachers* Second, students were eliminated if both first 

♦Edgar i* * borgatta and Rayiaond J* Corsini, Quick V;brd 
Test ; Level 2 (i^'ew York: Harcourt, brace and world, Inc*, 1964)* 

This test appears to be superior to the test in Equality of 
Educational Opportunity as it appears to give better discrimina- 
tion among teachers* One complaint voiced about the EEC test is 
that it was too easy* 
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and third grade achievement test scores were not available* When 
these criteria were applied, a total of 106l students was left in 
the sample. 

This sarriple allows another method of dealing with the 
problem of initial endowments. In particular, since there is a 
measure of previous test scores, it is possible to restrict the 
analysis entirely to one period of schooling by including the 
previous score for an individual as an input into the process. 

In this matter all of the level determining aspects of innate 
abilities can be eliminated. This seems to go a long way toward 
minimizing any biases arising from this missing information. 

Looking at one school district has both advantages and 
disadvantages, iiany hard-to-measure attributes of a school such 
as curriculum, school organization, community attitudes, etc. are 
automatically taken care of by looking at one school system. 

'Thus, potential biases from community or system specific variables 
which cannot or are not measured are eliminated in such a sample. 
However, the same arguments can be turned around in the other 
direction, by looking at only one system it is difficult to 
make generalizations about behavior in other systems located in 
different regions and having different types of organization. If 
system specific attributes are very important, it might not be 
possible to apply estimated models to other systems, 'This iraplies 
that the previous section's analysis and the analysis in this 
section are very much complements of each other, iiach has 
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weaknesses, but consistency in the different samples would 
strengthen the results considerably. 

ii^pirical Kesults 

For analytic purposes the sample was divided into sub- 
samples. First, whites and Lexic an- Americans (the only minority 
group represented in the system) were separated. This follows the 
reasoning given for looking at whites and blacks separately. The 
nominal values of the proxies for background inputs do not 
necessarily have the same meaning for the two groups, and there 
is no reason to insist on the same model of the educational process 
for both groups. Further, the ethnic samples were divided on 
occupational grounds — fathers in manual or blue collar occupa- 
tions and non-manual or white collar occupations. This left three 
samples: white, raanual occupation (n = 515 ); white, non-manual 

occupation (n = 323); and x-iexic an -American, manual occupation 
(n = 140).* 

The first step in analyzing; the data was to estimate 
third grade achievement (A-) models using only the teacher 
inputs which are purchased by the system to represent school 
effects. 'IWo linear regression models were estimated (one using 

♦These samples are not exhaustive. Children vrith only 
mothers or no occupation reported for fathers x^rere not included. 

For whites, these groups totaled 36 students; for mexican-Americans , 
these groups plus the non-manual occupation group totaled 47. 

These samples were too small to study separately, and, thus, they 
were ignored. 
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first grade achievement as an input, the other not using it). 

The "pay parameters*' of years of teaciiing e^erience, possession 
ol a master *s degree (=1) or not (=0), and the number of college 
units beyond the highest degree represented the school inputs in 
the models. These attributes pertained to the specific second and 
third grade teachers for each student. 

As lable 2 and Tuole 3 sbly demonstrate, there is a general 
lack of statistical significanoe of these factors.* Cnly four of 
eighteen coefficients in the gross output case have significant 
t values; none in the value added case have significant t values. 
Further, of the significant coefficients, one has the wrong 
(unexpected) sign. The other three coefficients apply to the 
nuifiber of units beyond the highest degree and, thus, have no 
meaning when degree level (riAS'M) is not included in the model 
(or has an insignificant coefficient). The implication is 
immediately obvious — the things that schools are buying do not 
appear to be valuable in the educational process. 

However, the above results give minimum guidance to an 
administrator . Vdiile they indicate what he should not do, they 
give a very imperfect picture of x^hat he should do. For his 

I 

purposes vie wish to identify what attributes of teachers do seem 
to count. That is the emphasis of the remainder of this section. 

Separate models using different measures of teacher 
characteristics xjere again estimated for white, vjhite collar; 

*//hen ftf C 1»96, it is not possible to reject the 
hypothesis that the coefficient equals zero at the level. 
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TABLE 2; SIGNIFICANCE OF TEACfiiE a^FECTS ( Gross output) 



A3 = f( 



seXf income, siblings, no. absences, ^ Kexican-Ainerican 
aver, income in school, EIPERo* UNITS3, EXPER2 

>lASTJFJl2. t!NITS2) ^ 



f 

f 



t statistics 





White Kanual 


White Nonmanual 


Hex-Amer Kanual 


EXPER3 


• 74 


2.74 


-.04 


i!lAST£Il3 


•89 


-2.69 


-47 


UNITS3 




.21 


1.09 


EXF£R2 


-1.39 


-55 


•77 


liASTiat^ 


1.45 


-15 


-.42 


UKITS2 


2.26 


2.93 


-34 


TABLE 3 : 


SIGNIFICANCE OF TEACHER EFFECTS (Value Added) 


• 

II 


) + Ai 


t statistics 






White E;anual 


White Nonmanual 


Hex-Amer Eianual 


EXPJR^ 


• 

o\ 


1.69 


-45 


i'IASTER3 


.18 


.1.91 


•59 


UNITS3 


.9^ 


1.05 


1-77 


EXP£»2 


-.61 


•30 


1.31 


MASTER^ 


1.9^ 


.60 


-.00 


UNITS2 


•31 


0 

• 

1 


-1.60 
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for white, blue collar; and for hexican-American, blue collar. 

Ihe results for these groups were quite different. Teacher 
effects do not appear to be consistent across the three groups. 

White ^ianual 

■Hie white, manual occupation model comes closest to the 
previous school models. Equation 2 displays the model of the 
production of Stanford Achievement Test (Reading) scores estimated 
for 515 third graders. Variable definitions, means and standard 
deviations are found in Table 4. 'Jhird grade achievement is a 
function of the starting point (first grade achievement, 
sex (i), grade repeats (R), and a set of teacher inputs. 

(2) Ao = 20.8 + 2.81F - 6.38R + . 79 A^ - .07D + .O9T0 - .57Y-. 

(2.3) (-2.8) (18.6) (-2.1) (2.4)^ (-1.5^ 

+ .O6T2 SE = 13.5 

(1.9) (-2.97 

Again, the interest here centers on the teacher inputs. 

The variable D represents the teacher *s estimate of the percentage 
of classroom time spent on discipline. This gives some idea of 
the intensity of instruction received by the individual student. 

As e^qjected, this has a negative impact on achievement; as more 
time is spent on discipline, less is spent on instruction* This 
suggests that there arc noticeable externalities in the classroom 
and that efforts to reduce discipline time in the classroom would 
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table 4 

VARIABLE DEFINITIONS. NEANS AND STANDARD DEVIATIONS - 



WHITE fiANUAL OCCUPATION HODEL 



Variable 


Eean 


Stnd. Dev. 


Definition 


h 


55.7'^ 


19.1 


Stanford Achievement Test 
raw score - 3rd grade 


F 


.50 


.5 


Sex: = 1 for female 

= 0 for male 


R 


.08 


.3 


Repeat grade: = 1 if a grade 

was repeated; = 0 otherwise 


h 


35.17 


15.1 


Stanford Achievement Test 
raw score - 1st grade 


D 


17.93 


18.8 


% of time spent on discipline 
by 3rd grade teacher 


■^3 


66.90 


15.8 


Quick Word Test score - 
3rd grade teacher 


^3 


1.91 


1.6 


Years since most recent 
educational experience - 
3rd grade teacher 


"2 


68.41 


19.0 


Quick V/ord Test score - 
2nd grade teacher 


^2 


2.64 


2.6 


Years since most recent 
educational experience - 
2nd grade teacher 



have positive results on achievement* For exan^le. the principal 
might assume a very high proportion of discipline chores. 

Two characteristics of both the second and third grade 
teachers were significant. Verbal facility test scores and length ^ 
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of time since most recent educational ejcperience of the teacher 
proved to be important attributes affecting achievement. The 
third grade teacher elasticity at the point of means of .11 for T 
and the second grade elasticity of .07 fall in line with those from 
the previous school, analysis* It is a little surprising, however, 
that the elasticities are slightly less here than in the other 
models. The other teacher variable, Y, indicates that recent 
educational e^eriences — either undergraduate or graduate level ~ 
are important. Thus, efforts to have teachers return to school 
during summers seem justified in terms of effects on euucatiuii. 

The cumulative effect (master *s degree and total units) is not 
as inqjortant as recent involvement. 

There are some ii> 5 )ortant policy implications surrounding 
the verbal test measure of teacher quality. By interchanging 
teachers at the top and bottom of the verbal ability scale for 
this sjrstem, achievement changes by .2 to .4 grade levels.* This 
seems quite significant at this grade level, particularly if the 
increasing grade level disparities hypothesized in JSquality of 
■Sducational Opportunity hold true for the individuals in this 
sample.** Thus, teacher distribution can have a significant 
effect on individual children. Further, since this test has 
national norms, it is possible to get some idea of how the 

*This is calculated by changing only the third grade 
teacher verbal score for the lower limit and both second and third 
for the upper limit. The scores are changed from 40 to 96 to 
represent the range found in the data, (iiaximum score is 100.) 

The resulting achievement score is then converted to grade level 
equivalents . 



* *£E0 , Chapter 3» 





teachers being hired in this system rate when conqiared with other 
college graduates, 'fhe mean score of 68 places the teachers in 
this sample slightly under the median for female college graduates. 
Thus, this system is not being successful in attracting the best 
people. 



»'/hite f-ionmanual 

The model estimated for the 323 children with v/hite 
collar backgrounds (ifijuation 3) did not show the importance of 
teachers to be as high as in the blue collar white sample. 
Definitions, means and standard deviations are found in Table 5. 
ibuation 3 indicates that, given the first grade achievement of 
the student, children with fathers in clerical occupatiois (C) 
score lower, i^tirther, the recentness of educational experience (l) 
is again a factor along with the amount of experience the teacher 
has had with this socio-economic level(S). 

(3) A = 35,9 + .72A1- 5.1c . .791, + .icBo - .661, + ,20a, 

^ (-3.0; (.-1.9) a.2r (-1.7; (1.8;^ 

= .52 is = 11.8 

izJach of these teacher variables is statistically less 
significant than the teacher variables in iiiuation 2. Further, 
the magnitudes of the coefficients suggest that teachers have 
less effect on these children. The elasticity at point of means 



TABLii 4 



VARIAdLh; DitlNITIONii , iixi/lJiS AwD STANDARD DjiVlATIOwS - 



ViHITi!l iJOru-iAivuAL OCCOPATICft riCDEL 



variable 


i-.ean 


S^no.* ij©v • 


Definition 


A.. 

J) 


64.62 


16.0 


btanford Achievement Test 
ravf score - 3rd grade 




42.43 


15.8 


btanford Achievement Test 
raw score - 1st grade 


c 


.19 


1 . 


Clerical occupation: = 1 if 
father in clerical job; 

= 0 otherwise 




2.02 


1.7 


Tears since most recent 
educational experience - 
3rd grade teacher 


S3 


7.35 


8.1 


Tears of experience Xvd.th this 
socio-econoriiic level - 3rd 
grade teacher 




1.88 


I-.7 


Years since most recent 
educational experience - 
2nd grade teacher 


^2 


7.94 


6.1 


Years of experience with this 
socio-economic level - 2nd 
grade teacher 



for each of the four teacher variables is less than .025» Thus, 
changing the input values by any reasonable araount yields a 
considerably smaller achievement change than was found' changing 
teacher inputs in the sample of children in blue collar fa^riilies. 
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Kexican-Awerican Manual 

In looking at the 140 hexican-American children, it was 
in^ossible to find any discernible impact of schools. The best 
model of the educational process for these children, Eij-iation 4, 
shows that in addition to entering achievement score (Aj^),-.only 
sex (F), grade repeated (R), and differences in family background 
(S5 and SK) affect third grade achilevement. Variable definitions, 
means and standard deviations are found in Table 6. 

(4) A, = 14.6 5- 97A. + 2.84F - 8.92R + 8.22SK + 5-96SS 

^ ( 9 . 7 ; (1.2) (-2.0) (2.7) - (2.0) 

r 2 = .51 sjs = 13.8 

None of the measwable factors used in this analysis concerning 
teachers in^acted on these children, at least in the production 
of reading achievement. This is a shocking result, and not without 
its policy implications. The system has not been able to provide 
the type of instruction necessary for these children. Standard 
teaching methods do not seem to be appropriate in this case. 

Individual Student Models 

In developing each of the models a set of variables 
corresponding to some common hypotheses about the educational 
process was also examined. Consistently, the influence of peers 
(measured by aggregate characteristics of all third graders in 
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TAuLE 6 

VARIABLE DEFIrilTIOl^S , IiSAi^ AND SmDARD DEVIATIONS - 
MEXICAIj 1-iANUAL OCCUPATION riOIEL 



Variable 


Mean 


Stnd# Dev# 


Definition 




47.61 


19 #4 


Stanford Achievement Test 
raw score - Jrd grade 


h 


28 #06 


12#3 


Stanford Achievement Test 
raw score - 1st grade 


F 


.5^ 


.5 


Sex: = 1 for female 

= 0 for male 


R 


CO 

0 

• 


.3 


Repeat grade: = 1 if a grade 

was repeated; = 0 otherwise 


SK 


.34 


.5 


Skilled labor; = 1 if 
skilled occupation; = 0 
otherwise 


SS 


00 

• 


.3 


Semi-skilled labor: = 1 if 

semi-skilled; = 0 otherwise 



the 25 schools for the sample) was found to be insignificant# 

Peer influences, were measured in a number of specific ways • 
Occupational distribution was depicted by percentage in nonmanual 
occupation and average income level; ethnic distribution by percent 
Wexican-American# Further, ability distribution was considered 
in terms of average achievement scores in the first grade# For 
teachers, attitudes about compensatory education and minority 
students proved insignificant# Teacher age, sex and undergraduate 
major also showed no effect# Thus, the models displayed imply 




a set of other hypotheses which proved ifisipnificant. 

In terras of teachers the three wodsis can be rank ordered. 
Teachers have most effect on white chilciren frora blue collar 
families and least effect on children frora i«:exican-Aiaerican 
families. This is disappointing since iiexican-Aiiierican children 
are worst off at the beginning of the process (first grade for 
this analysis), 'fhe idea of schools* equalizing initial deficits 
of these children is obviously not realized. 

For the white population teachers obviously do count. 
Better teachers imply better results. However, better teachers 
are not measured in the direction that schools measure ther/i by 
their pay schedules. Instead they are measured in terras of verbal 
ability, recentness of education and specific socio-econoraic 
class experience. Tliis iraplies that schools are being ineffi- 
cient — for a sraaller expenditure on teachers schools could reach 
the sarae level of achieveraent. moreover, there are gains to be 
made in the school systems from changing their hiring and pay 
systems . 



Iv, Conclusions and Implications 

The two separate analyses are complements. iLach indivi- 
dual analysis has a set of problems associated with it that tends 
to dilute the findings. However, taken together each appears to 
make up for the larger probleras of the other. Thus, the sura of 
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the two provides a much raore reliable picture of education. 

'Ihroughout the analysis there is never much question 
about the ability to model the general educational process, at 
least as seen in the elementary school. As an overall view of 
education the models seem to do quite well. The effects depicted 
are consistent with a priori views; the individual elements are 
statistically significant; and the general. e:;q)lanatory power of 
the models seems reasonable. 

The strongest conclusion from the models is that school 
systems now operate quite inefficiently. They are buying the 
wrong attributes of teachers, i.e., attributes which lead to 
little or no achievement gains. However, it is more difficult 
to develop the positive side. There are attributes which appear 
to be quality related which affect achievement. Yet, they can 
also be interpreted as proxies for other factors. To the extent 
that verbal facility is just a proxy for general ability or 
intelligence, then it is not verbal facility which we want to 
purchase; it is intelligence. Once a hiring policy for verbal 
ability was instituted, any relationship betvreen verbal ability 
and intelligence would tend to disappear or possibly reverse. 

Thus, these models do not provide a practical guide to the school 
administrator. They only say that there is something there that 
is desirable for teachers to have. 

It is strange to find strong teacher effects for blacks and 
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no t Hexican-Americans • Biis suggests that it is not just depri- 
vation or a lower educational input from outside the school. The 
most plausible explanation is found in the language problem. 

There is no measure of the intensity of Spanish language input 
for each of the Mexican- American children. This omission could 
obscure any teacher relationship, especially when measured in 
terms of English reading ability. However, the insignificant 
effects of schools on these children make it difficult to argue 
against community control plans for this community. 

A large caveat is needed at this point. The only measure 
of output used in this paper has been achievement test scores. 

This seems to be very important in terr.is of fiirther education as 
that builds upon this foundation. However, this is probably not 
the only output in schools. In particular, teachers of Iiexican- 
American children may spend a large proportion of their time on 
socialization aspects of education, e.g., discussing the Araerican 
heritage or accepted behavioral patterns. This type of instruction 
by teachers, although somewhat improbable, could lead to the 
results of Equation 4. 

There seem to be a number of directions in which one could 
proceed at this point. It is obvious that more information about 
the different dimensions of teacher quality is needed. One must 
be able to break down the verbal facility measure used in this 
paper. At the same time it is necessary to develop a model in 
terms of attributes which the administrator can purchase. While 
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some analysis, particularly that of Levin, suggests that schools 
implicitly buy attributes suck as teacher verbal facility, buying 
these through a scale in terms of e5q>erience and education cannot 
help but be inefficient.* Further, it is evident through comparing 
verbal scores for teachers with national norms that present salary 
schedules do not attract the best college graduates into teaching. 
Hoviever, more information is needed about the supply schedules for 
specific teacher attributes i 

At the same time it appears to be very important to eaqpand 
the measures of output. Achievement test scores certainly do not 
reflect all dimensions of educational output. The relationship 
among different outputs of education is very imperfectly understood 
at this point. 

Finally, it is important to broaden the California type 
sample. It is necessary to develop refined samples over a wide 
range of experiences. This includes matching students with specific 
inputs. It is necessary to look at different grades and different 
school systems. Further, the necessity of refining our measures 
of teachers is obvious. 




*See Recruiting Teachers . 



APhfiSDIX A 



CGhPLETE MULTISlCSm SCHOOL i-iODEIS (Verbal ability) 

(log-log iQodels) 



Variable 



WHITE BLACK 

Coefficient Coefficient 
(t statistic)(t statistic) 



Central City: = 1 if cc 


-.025 


-.042 


= 0 otherwise 


(-4.1) 


(-?-. 5 ) 


Goods in home (average number with auto. 


TV, refrigerator, record player and 


.599 


.662 


phone) 


(10.4) 


(7.9) 


Father *s education (years) 


.133 


.022 




(4.4) 


(. 4 ) 


People in home 


-.049 


-.177 




( 1 . 8 ) 


(-3.0) 


jo who attended nursery school 


.015 

( 4 . 0 ) 




student out migration during past year 


—005 

(-1.8) 




$ who wish to finish high school or more 


•319 


.590 




( 4 . 8 ) 


(5.5) 


■jo who feel they don*t have much chance for 


-.027 


-.028 


success 


(5.9) 


(-2.3) 


Racial concentration: = jo Regro if between 




45 and 75 percent 




-.011 


= 0 otherwise 




(-2.5) 


Racial concentration: = jo Hegro if greater 




than 75 percent 


-.036 


-.006 


= 0 otherwise 


(-3.3) 


(-1.3) 


jo with nonwhite teacher dm^ing the past 


-.024 


-.026 


year 


(-7.1) 


(-1.7) 


Average score on teacher verbal test 


.117 


.178 




( 2 . 2 ) 


( 2 . 0 ) 


Average years of teaching eacperience 


.020 


.045 




( 3 . 2 ) 


( 2 . 6 ) 



